Markov chains and applications
نویسندگان
چکیده
This work has three important purposes: first it is the study of Markov Chains, second to show that chains have different applications and finally model a process this behaves. Throughout we will describe what chain is, these processes are for how classified. We Chain, analyze primary elements make up chain, among others.
منابع مشابه
Markov Chains and Applications
In this paper I provide a quick overview of Stochastic processes and then quickly delve into a discussion of Markov Chains. There is some assumed knowledge of basic calculus, probability, and matrix theory. I build up Markov Chain theory towards a limit theorem. I prove the Fundamental Theorem of Markov Chains relating the stationary distribution to the limiting distribution. I then employ this...
متن کاملAdiabatic times for Markov chains and applications
We state and prove a generalized adiabatic theorem for Markov chains and provide examples and applications related to Glauber dynamics of the Ising model over Zd/nZd. The theorems derived in this paper describe a type of adiabatic dynamics for `(R+) norm preserving, time inhomogeneous Markov transformations, while quantum adiabatic theorems deal with `2(Cn) norm preserving ones, i.e. gradually ...
متن کاملEmpirical Bayes Estimation in Nonstationary Markov chains
Estimation procedures for nonstationary Markov chains appear to be relatively sparse. This work introduces empirical Bayes estimators for the transition probability matrix of a finite nonstationary Markov chain. The data are assumed to be of a panel study type in which each data set consists of a sequence of observations on N>=2 independent and identically dis...
متن کاملMonotonicity in Markov Reward and Decision Chains: Theory and Applications
This paper focuses on monotonicity results for dynamic systems that take values in the natural numbers or in more-dimensional lattices. The results are mostly formulated in terms of controlled queueing systems, but there are also applications to maintenance systems, revenue management, and so forth. We concentrate on results that are obtained by inductively proving properties of the dynamic pro...
متن کاملSingularly Perturbed Markov Chains : Limit Results and Applications
This work focuses on time-inhomogeneous Markov chains with two time scales. Our motivations stem from applications in reliability and dependability, queueing networks, financial engineering and manufacturing systems, where two-time-scale scenarios naturally arise. One of the important questions is: As the rate of fluctuation of the Markov chain goes to infinity, if the limit distributions of su...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Selecciones matematicas
سال: 2022
ISSN: ['2411-1783']
DOI: https://doi.org/10.17268/sel.mat.2022.01.05